2025-10-06 23:33:30,201 [ 97971 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2025-10-06 23:33:30,202 [ 97971 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2025-10-06 23:33:30,202 [ 97971 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2025-10-06 23:33:30,202 [ 97971 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_3coo6e --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 'test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database]' 'test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid]' test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_config_reload test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_page_cache test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_ddl_alter_query/test.py::test_alter test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] test_disks_app_func/test.py::test_disks_app_func_cp test_disk_over_web_server/test.py::test_cache[node2] test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] test_buffer_profile/test.py::test_buffer_profile test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection [gw9] [ 1%] PASSED test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile [gw9] [ 2%] PASSED test_buffer_profile/test.py::test_default_profile test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async [gw7] [ 3%] PASSED test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible [gw3] [ 4%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection [gw7] [ 5%] PASSED test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw6] [ 6%] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_aggregation_memory_efficient/test.py::test_remote [gw6] [ 7%] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container [gw3] [ 8%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml [gw3] [ 9%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml [gw6] [ 10%] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw3] [ 11%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw1] [ 12%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default [gw3] [ 13%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw0] [ 14%] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] [gw8] [ 15%] PASSED test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change [gw9] [ 16%] PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_detached_parts_metrics/test.py::test_numbers_of_detached_parts [gw1] [ 17%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] [gw8] [ 18%] PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] [gw6] [ 19%] PASSED test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default [gw7] [ 20%] PASSED test_aggregation_memory_efficient/test.py::test_remote [gw0] [ 21%] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk [gw1] [ 22%] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica [gw0] [ 23%] PASSED test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_default_database_on_cluster/test.py::test_default_database_on_cluster test_cleanup_after_start/test.py::test_old_dirs_cleanup [gw5] [ 24%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts [gw1] [ 25%] PASSED test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes [gw0] [ 26%] PASSED test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works [gw0] [ 27%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] [gw1] [ 28%] PASSED test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes [gw0] [ 29%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] test_backup_restore_on_cluster/test.py::test_empty_replicated_table [gw0] [ 30%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] [gw0] [ 31%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] [gw1] [ 32%] PASSED test_backup_restore_on_cluster/test.py::test_empty_replicated_table [gw0] [ 33%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] test_backup_restore_on_cluster/test.py::test_file_deduplication [gw0] [ 34%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] [gw3] [ 35%] PASSED test_detached_parts_metrics/test.py::test_numbers_of_detached_parts [gw0] [ 36%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] [gw1] [ 37%] PASSED test_backup_restore_on_cluster/test.py::test_file_deduplication [gw0] [ 38%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] [gw5] [ 39%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] test_backup_restore_on_cluster/test.py::test_get_error_from_other_host [gw0] [ 40%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] [gw1] [ 41%] PASSED test_backup_restore_on_cluster/test.py::test_get_error_from_other_host [gw0] [ 42%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] test_backup_restore_on_cluster/test.py::test_keeper_value_max_size [gw2] [ 43%] PASSED test_disk_over_web_server/test.py::test_cache[node2] test_disk_over_web_server/test.py::test_config_reload [gw2] [ 44%] PASSED test_disk_over_web_server/test.py::test_config_reload test_disk_over_web_server/test.py::test_incorrect_usage [gw0] [ 45%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] [gw2] [ 46%] PASSED test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_page_cache [gw0] [ 47%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] [gw0] [ 48%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] [gw1] [ 49%] PASSED test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation [gw0] [ 50%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] [gw6] [ 51%] PASSED test_default_database_on_cluster/test.py::test_default_database_on_cluster [gw0] [ 52%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] [gw8] [ 53%] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw0] [ 54%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] [gw7] [ 55%] FAILED test_cleanup_after_start/test.py::test_old_dirs_cleanup [gw1] [ 56%] PASSED test_backup_restore_on_cluster/test.py::test_mutation [gw0] [ 57%] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] [gw4] [ 58%] PASSED test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld [gw4] [ 59%] PASSED test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_backup_restore_on_cluster/test.py::test_projection [gw2] [ 60%] PASSED test_disk_over_web_server/test.py::test_page_cache test_disk_over_web_server/test.py::test_replicated_database test_config_xml_yaml_mix/test.py::test_extra_yaml_mix [gw4] [ 61%] PASSED test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls [gw4] [ 62%] PASSED test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv [gw2] [ 63%] PASSED test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server [gw1] [ 64%] PASSED test_backup_restore_on_cluster/test.py::test_projection [gw0] [ 65%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] [gw4] [ 66%] PASSED test_disks_app_func/test.py::test_disks_app_func_mv test_backup_restore_on_cluster/test.py::test_replicated_database [gw1] [ 67%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database [gw0] [ 68%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] test_backup_restore_on_cluster/test.py::test_replicated_database_async [gw0] [ 69%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] [gw1] [ 70%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts [gw5] [ 71%] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] [gw0] [ 72%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried [gw7] [ 73%] PASSED test_config_xml_yaml_mix/test.py::test_extra_yaml_mix [gw9] [ 74%] PASSED test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts [gw1] [ 75%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts [gw0] [ 76%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] test_cgroup_limit/test.py::test_cgroup_cpu_limit [gw1] [ 77%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] [gw1] [ 78%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] test_backup_restore_on_cluster/test.py::test_replicated_table [gw0] [ 79%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] [gw1] [ 80%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table [gw9] [ 81%] PASSED test_cgroup_limit/test.py::test_cgroup_cpu_limit test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster [gw1] [ 82%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster [gw1] [ 83%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster [gw0] [ 84%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def [gw2] [ 85%] PASSED test_disk_over_web_server/test.py::test_unavailable_server test_disk_over_web_server/test.py::test_usage[node2] [gw1] [ 86%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert [gw1] [ 87%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert [gw0] [ 88%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge [gw2] [ 89%] PASSED test_disk_over_web_server/test.py::test_usage[node2] [gw1] [ 90%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath [gw1] [ 91%] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath [gw0] [ 92%] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] test_backup_restore_on_cluster/test.py::test_required_privileges [gw1] [ 93%] PASSED test_backup_restore_on_cluster/test.py::test_required_privileges test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] [gw1] [ 94%] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] [gw1] [ 95%] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] test_backup_restore_on_cluster/test.py::test_system_functions [gw1] [ 96%] PASSED test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users [gw1] [ 97%] PASSED test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def [gw1] [ 98%] PASSED test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty [gw1] [ 99%] PASSED test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency [gw1] [100%] PASSED test_backup_restore_on_cluster/test.py::test_tables_dependency =================================== FAILURES =================================== ____________________________ test_old_dirs_cleanup _____________________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 start_cluster = def test_old_dirs_cleanup(start_cluster): node1.query("INSERT INTO test_table VALUES (toDate('2020-01-01'), 1, 10)") assert node1.query("SELECT count() FROM test_table") == "1\n" node1.stop_clickhouse() node1.exec_in_container( [ "bash", "-c", "mv /var/lib/clickhouse/data/default/test_table/20200101_0_0_0 /var/lib/clickhouse/data/default/test_table/delete_tmp_20200101_0_0_0", ], privileged=True, ) node1.start_clickhouse() result = node1.exec_in_container( ["bash", "-c", "ls /var/lib/clickhouse/data/default/test_table/"], privileged=True, ) # Replaced empty part > assert "20200101_0_0_0" in result E AssertionError: assert '20200101_0_0_0' in '20200101_0_0_1\ndetached\nformat_version.txt\n' test_cleanup_after_start/test.py:58: AssertionError ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2025-10-06 23:34:24 [ 670 ] INFO : Running tests in /ClickHouse/tests/integration/test_cleanup_after_start/test.py (cluster.py:2788, start) 2025-10-06 23:34:24 [ 670 ] DEBUG : Cluster start called. is_up=False (cluster.py:2795, start) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker networks for project roottestcleanupafterstart_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker containers for project roottestcleanupafterstart_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker volumes for project roottestcleanupafterstart_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker networks for project roottestcleanupafterstart_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker containers for project roottestcleanupafterstart_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Docker volumes for project roottestcleanupafterstart_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-10-06 23:34:24 [ 670 ] DEBUG : Command:docker container list --all --filter name='^/roottestcleanupafterstart_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2025-10-06 23:34:24 [ 670 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : No running containers for project: roottestcleanupafterstart_gw7 (cluster.py:904, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2025-10-06 23:34:24 [ 670 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2025-10-06 23:34:24 [ 670 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-10-06 23:34:24 [ 670 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2025-10-06 23:34:24 [ 670 ] DEBUG : Stdout:5 (cluster.py:121, run_and_check) 2025-10-06 23:34:24 [ 670 ] DEBUG : Setup directory for instance: node1 (cluster.py:2808, start) 2025-10-06 23:34:24 [ 670 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4534, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Create directory for common tests configuration (cluster.py:4539, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Copy common configuration from helpers (cluster.py:4559, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Generate and write macros file (cluster.py:4602, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/configs/config.d (cluster.py:4632, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/database (cluster.py:4649, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/logs (cluster.py:4660, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4746, create_dir) 2025-10-06 23:34:24 [ 670 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:1e0b53d756cf', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env (cluster.py:86, _create_env_file) 2025-10-06 23:34:24 [ 670 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-10-06 23:34:24 [ 670 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-10-06 23:34:24 [ 670 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-10-06 23:34:24 [ 670 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-10-06 23:34:24 [ 670 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 824 (connectionpool.py:547, _make_request) 2025-10-06 23:34:24 [ 670 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', '--project-name', 'roottestcleanupafterstart_gw7', '--file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'pull'] (cluster.py:113, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:36 [ 670 ] DEBUG : Setup ZooKeeper (cluster.py:2849, start) 2025-10-06 23:34:36 [ 670 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/log', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/config', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/log', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/config', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/coordination', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/log', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/config', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/coordination'] (cluster.py:2850, start) 2025-10-06 23:34:36 [ 670 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', '--project-name', 'roottestcleanupafterstart_gw7', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--verbose', 'up', '-d'] (cluster.py:113, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:docker-py version: (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-130-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': '1.7.25', 'Details': {'GitCommit': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb'}}, {'Name': 'runc', 'Version': '1.2.4', 'Details': {'GitCommit': 'v1.2.4-0-g6c52b3f'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-130-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestcleanupafterstartgw7_default') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'ID': 'bcc810d6b9066471b0b6fa75f557a15a1cbf31bb'}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Containers': 27, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestcleanupafterstart_gw7_default') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestcleanupafterstart_gw7_default" with the default driver (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestcleanupafterstart_gw7_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestcleanupafterstart_gw7', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': '58989ea3c154bd9d24cf3c150a8f8eca44fc31644516773c2261ff9bc499617a', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {, , } (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstart_gw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestcleanupafterstart_gw7', service='zoo1', number=1)} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestcleanupafterstart_gw7', service='zoo1', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestcleanupafterstartgw7', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo2_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestcleanupafterstart_gw7', service='zoo2', number=1)} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestcleanupafterstart_gw7', service='zoo2', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo3_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestcleanupafterstart_gw7', service='zoo3', number=1)} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestcleanupafterstart_gw7', service='zoo3', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:1e0b53d756cf') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 3371e7362474565c0bb00cb25265f0fe7870cd55e5e1d623a8ab034bd99405de (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestcleanupafterstart_gw7_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Target': '/var/lib/clickhouse-keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config1.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestcleanupafterstart_gw7_zoo1_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestcleanupafterstart_gw7', 'com.docker.compose.service': 'zoo1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '3371e7362474565c0bb00cb25265f0fe7870cd55e5e1d623a8ab034bd99405de'}, host_config={'NetworkMode': 'roottestcleanupafterstart_gw7_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestcleanupafterstart_gw7_default': {'Aliases': ['zoo1'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: bc273ece909c8267e4bd17e3824bec41cf2fd6ed26f1cecd9956648aa48cae72 (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestcleanupafterstart_gw7_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse-keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config2.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestcleanupafterstart_gw7_zoo2_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestcleanupafterstart_gw7', 'com.docker.compose.service': 'zoo2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'bc273ece909c8267e4bd17e3824bec41cf2fd6ed26f1cecd9956648aa48cae72'}, host_config={'NetworkMode': 'roottestcleanupafterstart_gw7_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestcleanupafterstart_gw7_default': {'Aliases': ['zoo2'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Author': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: bbe3197a6c02ae1a55d2364d94c78c499beba327e55aeee2f4f9e2cca3bec8bd (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestcleanupafterstart_gw7_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Links': [], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/log', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Target': '/var/log/clickhouse-keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config3.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:1e0b53d756cf', user='0', volumes={}, name='roottestcleanupafterstart_gw7_zoo3_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestcleanupafterstart_gw7', 'com.docker.compose.service': 'zoo3', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/ClickHouse/tests/integration/compose', 'com.docker.compose.project.config_files': '/ClickHouse/tests/integration/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'bbe3197a6c02ae1a55d2364d94c78c499beba327e55aeee2f4f9e2cca3bec8bd'}, host_config={'NetworkMode': 'roottestcleanupafterstart_gw7_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestcleanupafterstart_gw7_default': {'Aliases': ['zoo3'], 'IPAMConfig': {}}}}) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'b8d14b4e8ddbb876e4b8f1b3ef000e5ca475e834ca700d5ffbfc678fff107483', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('b8d14b4e8ddbb876e4b8f1b3ef000e5ca475e834ca700d5ffbfc678fff107483') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'fc17c85e92b98c5374ea6a78bb25d2367e986b372d9bc0940d2c49da5060128e', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('fc17c85e92b98c5374ea6a78bb25d2367e986b372d9bc0940d2c49da5060128e') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '515cfa35c82736c4bbaaa1169bae4f77225448793436038afc94ed7faf32a32d', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('515cfa35c82736c4bbaaa1169bae4f77225448793436038afc94ed7faf32a32d') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config3.xml', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('b8d14b4e8ddbb876e4b8f1b3ef000e5ca475e834ca700d5ffbfc678fff107483', 'roottestcleanupafterstart_gw7_default') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config1.xml', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('fc17c85e92b98c5374ea6a78bb25d2367e986b372d9bc0940d2c49da5060128e', 'roottestcleanupafterstart_gw7_default') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config2.xml', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:... (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('515cfa35c82736c4bbaaa1169bae4f77225448793436038afc94ed7faf32a32d', 'roottestcleanupafterstart_gw7_default') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('fc17c85e92b98c5374ea6a78bb25d2367e986b372d9bc0940d2c49da5060128e', 'roottestcleanupafterstart_gw7_default', aliases=['fc17c85e92b9', 'zoo1'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('b8d14b4e8ddbb876e4b8f1b3ef000e5ca475e834ca700d5ffbfc678fff107483', 'roottestcleanupafterstart_gw7_default', aliases=['zoo3', 'b8d14b4e8ddb'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('515cfa35c82736c4bbaaa1169bae4f77225448793436038afc94ed7faf32a32d', 'roottestcleanupafterstart_gw7_default', aliases=['zoo2', '515cfa35c827'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('b8d14b4e8ddbb876e4b8f1b3ef000e5ca475e834ca700d5ffbfc678fff107483') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('fc17c85e92b98c5374ea6a78bb25d2367e986b372d9bc0940d2c49da5060128e') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('515cfa35c82736c4bbaaa1169bae4f77225448793436038afc94ed7faf32a32d') (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestcleanupafterstart_gw7', service='zoo3', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo3_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestcleanupafterstart_gw7', service='zoo1', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestcleanupafterstart_gw7', service='zoo2', number=1) (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_zoo2_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:123, run_and_check) 2025-10-06 23:34:39 [ 670 ] DEBUG : Wait ZooKeeper to start (cluster.py:2504, wait_zookeeper_to_start) 2025-10-06 23:34:39 [ 670 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:2135, get_instance_ip) 2025-10-06 23:34:39 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestcleanupafterstart_gw7_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:39 [ 670 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.17.3, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2025-10-06 23:34:39 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:39 [ 670 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-10-06 23:34:39 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:39 [ 670 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-10-06 23:34:39 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:39 [ 670 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-10-06 23:34:39 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:39 [ 670 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-10-06 23:34:40 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:40 [ 670 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2025-10-06 23:34:42 [ 670 ] INFO : Connecting to 172.16.17.3(172.16.17.3):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-10-06 23:34:42 [ 670 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-10-06 23:34:42 [ 670 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-10-06 23:34:42 [ 670 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:2135, get_instance_ip) 2025-10-06 23:34:42 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestcleanupafterstart_gw7_zoo2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:42 [ 670 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.17.4, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2025-10-06 23:34:42 [ 670 ] INFO : Connecting to 172.16.17.4(172.16.17.4):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-10-06 23:34:42 [ 670 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-10-06 23:34:42 [ 670 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-10-06 23:34:42 [ 670 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-10-06 23:34:42 [ 670 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-10-06 23:34:42 [ 670 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:2135, get_instance_ip) 2025-10-06 23:34:42 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestcleanupafterstart_gw7_zoo3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:42 [ 670 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.17.2, port:2181, use_ssl:False (cluster.py:3286, get_kazoo_client) 2025-10-06 23:34:42 [ 670 ] INFO : Connecting to 172.16.17.2(172.16.17.2):2181, use_ssl: False (connection.py:650, _connect) 2025-10-06 23:34:42 [ 670 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2025-10-06 23:34:43 [ 670 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2025-10-06 23:34:43 [ 670 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2025-10-06 23:34:43 [ 670 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2025-10-06 23:34:43 [ 670 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2025-10-06 23:34:43 [ 670 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2025-10-06 23:34:43 [ 670 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2025-10-06 23:34:43 [ 670 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2025-10-06 23:34:43 [ 670 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2025-10-06 23:34:43 [ 670 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2025-10-06 23:34:43 [ 670 ] DEBUG : All instances of ZooKeeper Secure started (cluster.py:2519, wait_zookeeper_nodes_to_start) 2025-10-06 23:34:43 [ 670 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env --project-name roottestcleanupafterstart_gw7 --file /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml up -d --no-recreate') (cluster.py:3146, start) 2025-10-06 23:34:43 [ 670 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', '--project-name', 'roottestcleanupafterstart_gw7', '--file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'up', '-d', '--no-recreate'] (cluster.py:113, run_and_check) 2025-10-06 23:34:44 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_node1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:44 [ 670 ] DEBUG : Stderr:Creating roottestcleanupafterstart_gw7_node1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:44 [ 670 ] DEBUG : ClickHouse instance created (cluster.py:3154, start) 2025-10-06 23:34:44 [ 670 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2135, get_instance_ip) 2025-10-06 23:34:44 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestcleanupafterstart_gw7_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:44 [ 670 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.17.5... (cluster.py:3161, start) 2025-10-06 23:34:44 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestcleanupafterstart_gw7_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:44 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:44 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:44 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:45 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:46 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:46 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:46 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:46 [ 670 ] DEBUG : http://localhost:None "GET /v1.42/containers/f2274096d0b9b3db16d197fdae4c36a5800429721bf83670b0eec2c3330292d3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-10-06 23:34:46 [ 670 ] DEBUG : ClickHouse node1 started (cluster.py:3165, start) 2025-10-06 23:34:46 [ 670 ] DEBUG : Executing query CREATE TABLE test_table(date Date, id UInt32, dummy UInt32) ENGINE = ReplicatedMergeTree('/clickhouse/tables/test_table', 'node1') PARTITION BY date ORDER BY id on node1 (cluster.py:3602, query) ------------------------------ Captured log call ------------------------------- 2025-10-06 23:34:46 [ 670 ] DEBUG : Executing query INSERT INTO test_table VALUES (toDate('2020-01-01'), 1, 10) on node1 (cluster.py:3602, query) 2025-10-06 23:34:46 [ 670 ] DEBUG : Executing query SELECT count() FROM test_table on node1 (cluster.py:3602, query) 2025-10-06 23:34:47 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:47 [ 670 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', 'ps -C clickhouse'] (cluster.py:113, run_and_check) 2025-10-06 23:34:47 [ 670 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:121, run_and_check) 2025-10-06 23:34:47 [ 670 ] DEBUG : Stdout: 8 ? 00:00:01 clickhouse (cluster.py:121, run_and_check) 2025-10-06 23:34:47 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:47 [ 670 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', 'pkill clickhouse'] (cluster.py:113, run_and_check) 2025-10-06 23:34:47 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:47 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:47 [ 670 ] DEBUG : Stdout:8 (cluster.py:121, run_and_check) 2025-10-06 23:34:48 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:48 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:48 [ 670 ] DEBUG : Stdout:8 (cluster.py:121, run_and_check) 2025-10-06 23:34:49 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:49 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:49 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', 'mv /var/lib/clickhouse/data/default/test_table/20200101_0_0_0 /var/lib/clickhouse/data/default/test_table/delete_tmp_20200101_0_0_0'] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:49 [ 670 ] DEBUG : Command:['docker', 'exec', '--privileged', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', 'mv /var/lib/clickhouse/data/default/test_table/20200101_0_0_0 /var/lib/clickhouse/data/default/test_table/delete_tmp_20200101_0_0_0'] (cluster.py:113, run_and_check) 2025-10-06 23:34:49 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:49 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:49 [ 670 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3964, start_clickhouse) 2025-10-06 23:34:49 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:49 [ 670 ] DEBUG : Command:['docker', 'exec', '-u', '0', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:113, run_and_check) 2025-10-06 23:34:50 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:50 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:51 [ 670 ] DEBUG : Stdout:768 (cluster.py:121, run_and_check) 2025-10-06 23:34:51 [ 670 ] DEBUG : Clickhouse process running. (cluster.py:3975, start_clickhouse) 2025-10-06 23:34:51 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:51 [ 670 ] DEBUG : Command:['docker', 'exec', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2025-10-06 23:34:51 [ 670 ] DEBUG : Stdout:768 (cluster.py:121, run_and_check) 2025-10-06 23:34:51 [ 670 ] DEBUG : Executing query select 20 on node1 (cluster.py:3602, query) 2025-10-06 23:34:51 [ 670 ] DEBUG : Executing query select 20 on node1 (cluster.py:3602, query) 2025-10-06 23:34:52 [ 670 ] DEBUG : run container_id:roottestcleanupafterstart_gw7_node1_1 detach:False nothrow:False cmd: ['bash', '-c', 'ls /var/lib/clickhouse/data/default/test_table/'] (cluster.py:2173, exec_in_container) 2025-10-06 23:34:52 [ 670 ] DEBUG : Command:['docker', 'exec', '--privileged', 'roottestcleanupafterstart_gw7_node1_1', 'bash', '-c', 'ls /var/lib/clickhouse/data/default/test_table/'] (cluster.py:113, run_and_check) 2025-10-06 23:34:52 [ 670 ] DEBUG : Stdout:20200101_0_0_1 (cluster.py:121, run_and_check) 2025-10-06 23:34:52 [ 670 ] DEBUG : Stdout:detached (cluster.py:121, run_and_check) 2025-10-06 23:34:52 [ 670 ] DEBUG : Stdout:format_version.txt (cluster.py:121, run_and_check) ---------------------------- Captured log teardown ----------------------------- 2025-10-06 23:34:52 [ 670 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', '--project-name', 'roottestcleanupafterstart_gw7', '--file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'stop', '--timeout', '20'] (cluster.py:113, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_node1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo3_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo2_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_node1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo2_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Stderr:Stopping roottestcleanupafterstart_gw7_zoo3_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2025-10-06 23:34:55 [ 670 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/.env', '--project-name', 'roottestcleanupafterstart_gw7', '--file', '/ClickHouse/tests/integration/test_cleanup_after_start/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', 'down', '--volumes'] (cluster.py:113, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_node1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo3_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo1_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo2_1 ... (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo2_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo3_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_zoo1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing roottestcleanupafterstart_gw7_node1_1 ... done (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stderr:Removing network roottestcleanupafterstart_gw7_default (cluster.py:123, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Docker networks for project roottestcleanupafterstart_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2025-10-06 23:34:56 [ 670 ] DEBUG : Docker containers for project roottestcleanupafterstart_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2025-10-06 23:34:56 [ 670 ] DEBUG : Docker volumes for project roottestcleanupafterstart_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2025-10-06 23:34:56 [ 670 ] DEBUG : Command:docker container list --all --filter name='^/roottestcleanupafterstart_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : No running containers for project: roottestcleanupafterstart_gw7 (cluster.py:904, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2025-10-06 23:34:56 [ 670 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2025-10-06 23:34:56 [ 670 ] DEBUG : Stdout:5 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 77.14s setup test_disks_app_func/test.py::test_disks_app_func_cp 53.94s setup test_disk_over_web_server/test.py::test_cache[node2] 50.64s call test_disk_over_web_server/test.py::test_unavailable_server 36.52s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 34.90s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 33.20s call test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 32.97s setup test_ddl_alter_query/test.py::test_alter 29.78s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 27.21s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 23.34s teardown test_disks_app_func/test.py::test_disks_app_func_mv 23.15s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] 22.45s setup test_default_database_on_cluster/test.py::test_default_database_on_cluster 21.82s setup test_cleanup_after_start/test.py::test_old_dirs_cleanup 21.79s call test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 21.07s setup test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 20.93s setup test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 20.86s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 20.34s setup test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 17.15s call test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 15.34s setup test_aggregation_memory_efficient/test.py::test_remote 15.10s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 14.81s call test_cgroup_limit/test.py::test_cgroup_cpu_limit 14.74s setup test_buffer_profile/test.py::test_buffer_profile 14.73s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 14.13s call test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 13.80s setup test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 13.25s call test_disk_over_web_server/test.py::test_cache[node2] 13.17s call test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] 12.93s call test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] 12.52s teardown test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 11.82s teardown test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 11.51s call test_disk_over_web_server/test.py::test_usage[node2] 11.41s call test_disk_over_web_server/test.py::test_page_cache 10.87s call test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] 10.57s call test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] 10.30s setup test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 9.90s call test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 9.26s teardown test_backup_restore_on_cluster/test.py::test_tables_dependency 8.60s teardown test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 8.02s teardown test_default_database_on_cluster/test.py::test_default_database_on_cluster 7.29s call test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 7.16s call test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 7.15s call test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 7.06s call test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 6.87s teardown test_disk_over_web_server/test.py::test_usage[node2] 6.76s call test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] 6.74s setup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 6.63s call test_backup_restore_on_cluster/test.py::test_tables_dependency 6.47s call test_backup_restore_on_cluster/test.py::test_replicated_database_async 6.30s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 6.30s call test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 6.26s teardown test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 6.23s teardown test_aggregation_memory_efficient/test.py::test_remote 5.91s call test_backup_restore_on_cluster/test.py::test_required_privileges 5.91s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 5.82s call test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] 5.63s call test_cleanup_after_start/test.py::test_old_dirs_cleanup 5.28s call test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 5.27s call test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 5.24s call test_backup_restore_on_cluster/test.py::test_mutation 5.17s call test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 5.13s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 5.11s call test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] 5.11s teardown test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 4.93s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 4.85s teardown test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 4.82s call test_backup_restore_on_cluster/test.py::test_replicated_database 4.77s teardown test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 4.73s teardown test_buffer_profile/test.py::test_default_profile 4.52s call test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 4.49s call test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 4.48s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 4.44s teardown test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts 4.16s teardown test_cleanup_after_start/test.py::test_old_dirs_cleanup 4.13s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 4.05s call test_backup_restore_on_cluster/test.py::test_replicated_table 4.04s call test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 4.01s call test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 3.99s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 3.87s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 3.83s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 3.70s call test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] 3.69s call test_backup_restore_on_cluster/test.py::test_system_functions 3.66s call test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 3.55s call test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] 3.54s call test_backup_restore_on_cluster/test.py::test_system_users 3.44s call test_backup_restore_on_cluster/test.py::test_projection 3.36s call test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 3.31s call test_default_database_on_cluster/test.py::test_default_database_on_cluster 3.24s call test_backup_restore_on_cluster/test.py::test_file_deduplication 3.21s call test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 3.21s call test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 3.02s call test_disks_app_func/test.py::test_disks_app_func_cp 2.94s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 2.83s call test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 2.76s call test_ddl_alter_query/test.py::test_alter 2.55s call test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 2.41s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 2.30s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 2.30s call test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 2.19s teardown test_backup_restore_on_cluster/test.py::test_mutation 2.18s call test_aggregation_memory_efficient/test.py::test_remote 2.16s call test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 2.07s call test_backup_restore_on_cluster/test.py::test_empty_replicated_table 2.04s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 2.04s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 2.00s teardown test_backup_restore_on_cluster/test.py::test_file_deduplication 1.98s call test_disk_over_web_server/test.py::test_replicated_database 1.96s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 1.92s call test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 1.86s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 1.77s call test_disk_over_web_server/test.py::test_incorrect_usage 1.73s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 1.73s teardown test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 1.73s teardown test_backup_restore_on_cluster/test.py::test_replicated_table 1.70s teardown test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 1.68s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] 1.65s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 1.63s teardown test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 1.63s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 1.62s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 1.58s teardown test_backup_restore_on_cluster/test.py::test_projection 1.58s teardown test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 1.58s teardown test_backup_restore_on_cluster/test.py::test_system_users 1.58s teardown test_backup_restore_on_cluster/test.py::test_required_privileges 1.53s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 1.53s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_async 1.53s teardown test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] 1.53s teardown test_backup_restore_on_cluster/test.py::test_system_functions 1.53s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 1.50s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 1.50s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] 1.48s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 1.48s teardown test_backup_restore_on_cluster/test.py::test_empty_replicated_table 1.48s teardown test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 1.48s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 1.48s teardown test_backup_restore_on_cluster/test.py::test_replicated_database 1.48s teardown test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 1.47s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 1.44s teardown test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 1.44s teardown test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 1.43s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 1.43s teardown test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 1.35s call test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default 1.34s teardown test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 1.34s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 1.33s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 1.33s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 1.32s call test_disks_app_func/test.py::test_disks_app_func_mv 1.28s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 1.27s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 1.22s call test_disks_app_func/test.py::test_disks_app_func_ln 1.22s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 1.20s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 1.18s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 1.18s call test_disks_app_func/test.py::test_disks_app_func_ls 1.17s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.75s call test_disk_over_web_server/test.py::test_config_reload 0.70s call test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 0.68s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.63s call test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.56s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 0.51s teardown test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.51s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.48s call test_buffer_profile/test.py::test_buffer_profile 0.44s call test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.43s call test_buffer_profile/test.py::test_default_profile 0.43s call test_disks_app_func/test.py::test_disks_app_func_ld 0.38s call test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 0.37s call test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.24s setup test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 0.16s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 0.11s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.11s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.11s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.10s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 0.00s teardown test_disk_over_web_server/test.py::test_cache[node2] 0.00s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] 0.00s setup test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] 0.00s teardown test_cgroup_limit/test.py::test_cgroup_cpu_limit 0.00s setup test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.00s setup test_backup_restore_on_cluster/test.py::test_system_functions 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] 0.00s setup test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_cp 0.00s setup test_cgroup_limit/test.py::test_cgroup_cpu_limit 0.00s setup test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 0.00s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 0.00s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.00s setup test_backup_restore_on_cluster/test.py::test_mutation 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] 0.00s setup test_backup_restore_on_cluster/test.py::test_system_users 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert 0.00s teardown test_ddl_alter_query/test.py::test_alter 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] 0.00s setup test_backup_restore_on_cluster/test.py::test_get_error_from_other_host 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge 0.00s setup test_backup_restore_on_cluster/test.py::test_projection 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] 0.00s setup test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def 0.00s teardown test_config_xml_yaml_mix/test.py::test_extra_yaml_mix 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_async 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster 0.00s setup test_ddl_alter_query/test.py::test_ddl_queue_hostname_change 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath 0.00s setup test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 0.00s setup test_buffer_profile/test.py::test_default_profile 0.00s setup test_disk_over_web_server/test.py::test_config_reload 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.00s setup test_backup_restore_on_cluster/test.py::test_file_deduplication 0.00s setup test_backup_restore_on_cluster/test.py::test_replicated_table 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 0.00s setup test_backup_restore_on_cluster/test.py::test_empty_replicated_table 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] 0.00s setup test_backup_restore_on_cluster/test.py::test_keeper_value_max_size 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] 0.00s setup test_disk_over_web_server/test.py::test_replicated_database 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] 0.00s setup test_backup_restore_on_cluster/test.py::test_required_privileges 0.00s teardown test_disk_over_web_server/test.py::test_unavailable_server 0.00s setup test_backup_restore_on_cluster/test.py::test_tables_dependency 0.00s setup test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes 0.00s setup test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] 0.00s setup test_disk_over_web_server/test.py::test_usage[node2] 0.00s teardown test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ld 0.00s setup test_disk_over_web_server/test.py::test_unavailable_server 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.00s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 0.00s setup test_disk_over_web_server/test.py::test_incorrect_usage 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.00s teardown test_disk_over_web_server/test.py::test_replicated_database 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ln 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.00s teardown test_buffer_profile/test.py::test_buffer_profile 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 0.00s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 0.00s setup test_disks_app_func/test.py::test_disks_app_func_ls 0.00s setup test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.00s teardown test_disk_over_web_server/test.py::test_page_cache 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.00s setup test_disks_app_func/test.py::test_disks_app_func_mv 0.00s setup test_disk_over_web_server/test.py::test_page_cache 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ln 0.00s teardown test_disk_over_web_server/test.py::test_config_reload 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ld 0.00s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 0.00s teardown test_disk_over_web_server/test.py::test_incorrect_usage 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.00s teardown test_disks_app_func/test.py::test_disks_app_func_ls =========================== short test summary info ============================ FAILED test_cleanup_after_start/test.py::test_old_dirs_cleanup - AssertionErr... PASSED test_buffer_profile/test.py::test_buffer_profile PASSED test_buffer_profile/test.py::test_default_profile PASSED test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection PASSED test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] PASSED test_ddl_alter_query/test.py::test_alter PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True] PASSED test_ddl_alter_query/test.py::test_ddl_queue_hostname_change PASSED test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default PASSED test_aggregation_memory_efficient/test.py::test_remote PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] PASSED test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True] PASSED test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed] PASSED test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica PASSED test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works PASSED test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] PASSED test_backup_restore_on_cluster/test.py::test_empty_replicated_table PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] PASSED test_detached_parts_metrics/test.py::test_numbers_of_detached_parts PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] PASSED test_backup_restore_on_cluster/test.py::test_file_deduplication PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] PASSED test_backup_restore_on_cluster/test.py::test_get_error_from_other_host PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] PASSED test_disk_over_web_server/test.py::test_cache[node2] PASSED test_disk_over_web_server/test.py::test_config_reload PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] PASSED test_disk_over_web_server/test.py::test_incorrect_usage PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] PASSED test_backup_restore_on_cluster/test.py::test_keeper_value_max_size PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] PASSED test_default_database_on_cluster/test.py::test_default_database_on_cluster PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] PASSED test_backup_restore_on_cluster/test.py::test_mutation PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] PASSED test_disks_app_func/test.py::test_disks_app_func_cp PASSED test_disks_app_func/test.py::test_disks_app_func_ld PASSED test_disk_over_web_server/test.py::test_page_cache PASSED test_disks_app_func/test.py::test_disks_app_func_ln PASSED test_disks_app_func/test.py::test_disks_app_func_ls PASSED test_disk_over_web_server/test.py::test_replicated_database PASSED test_backup_restore_on_cluster/test.py::test_projection PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] PASSED test_disks_app_func/test.py::test_disks_app_func_mv PASSED test_backup_restore_on_cluster/test.py::test_replicated_database PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_async PASSED test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded] PASSED test_config_xml_yaml_mix/test.py::test_extra_yaml_mix PASSED test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database] PASSED test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table PASSED test_cgroup_limit/test.py::test_cgroup_cpu_limit PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True] PASSED test_disk_over_web_server/test.py::test_unavailable_server PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False] PASSED test_disk_over_web_server/test.py::test_usage[node2] PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge PASSED test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath PASSED test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True] PASSED test_backup_restore_on_cluster/test.py::test_required_privileges PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False] PASSED test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True] PASSED test_backup_restore_on_cluster/test.py::test_system_functions PASSED test_backup_restore_on_cluster/test.py::test_system_users PASSED test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def PASSED test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty PASSED test_backup_restore_on_cluster/test.py::test_tables_dependency =================== 1 failed, 99 passed in 227.06s (0:03:47) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_3coo6e --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_aggregation_memory_efficient/test.py::test_remote test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-False]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[http-True]' 'test_backup_restore_on_cluster/test.py::test_async_backups_to_same_destination[native-True]' test_backup_restore_on_cluster/test.py::test_backup_restore_on_single_replica test_backup_restore_on_cluster/test.py::test_different_tables_on_nodes test_backup_restore_on_cluster/test.py::test_empty_replicated_table test_backup_restore_on_cluster/test.py::test_file_deduplication test_backup_restore_on_cluster/test.py::test_get_error_from_other_host test_backup_restore_on_cluster/test.py::test_keeper_value_max_size test_backup_restore_on_cluster/test.py::test_mutation test_backup_restore_on_cluster/test.py::test_projection test_backup_restore_on_cluster/test.py::test_replicated_database test_backup_restore_on_cluster/test.py::test_replicated_database_async test_backup_restore_on_cluster/test.py::test_replicated_database_compare_parts 'test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[database]' 'test_backup_restore_on_cluster/test.py::test_replicated_database_with_special_macro_in_zk_path[uuid]' test_backup_restore_on_cluster/test.py::test_replicated_table test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_bigger_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_restored_into_smaller_cluster test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_def test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_insert test_backup_restore_on_cluster/test.py::test_replicated_table_with_not_synced_merge test_backup_restore_on_cluster/test.py::test_replicated_table_with_uuid_in_zkpath test_backup_restore_on_cluster/test.py::test_required_privileges 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[False]' 'test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup[True]' test_backup_restore_on_cluster/test.py::test_system_functions test_backup_restore_on_cluster/test.py::test_system_users test_backup_restore_on_cluster/test.py::test_table_in_replicated_database_with_not_synced_def test_backup_restore_on_cluster/test.py::test_table_with_parts_in_queue_considered_non_empty test_backup_restore_on_cluster/test.py::test_tables_dependency test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backward_compatibility/test_insert_profile_events.py::test_new_client_compatible test_backward_compatibility/test_insert_profile_events.py::test_old_client_compatible test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_backward_compatibility/test_vertical_merges_from_compact_parts.py::test_vertical_merges_from_compact_parts test_buffer_profile/test.py::test_buffer_profile test_buffer_profile/test.py::test_default_profile test_cgroup_limit/test.py::test_cgroup_cpu_limit 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[qps_limit_exceeded]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[slow_down]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[total_qps_limit_exceeded]' test_checking_s3_blobs_paranoid/test.py::test_when_s3_broken_pipe_at_upload_is_retried 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_create_mpu_retried[True]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[False]' 'test_checking_s3_blobs_paranoid/test.py::test_when_s3_connection_reset_by_peer_at_upload_is_retried[True]' test_cleanup_after_start/test.py::test_old_dirs_cleanup test_concurrent_threads_soft_limit/test.py::test_concurrent_threads_soft_limit_default test_config_xml_yaml_mix/test.py::test_extra_yaml_mix test_ddl_alter_query/test.py::test_alter test_ddl_alter_query/test.py::test_ddl_queue_hostname_change test_default_database_on_cluster/test.py::test_default_database_on_cluster test_detached_parts_metrics/test.py::test_numbers_of_detached_parts 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_executable_hashed.py::test_simple[hashed]' test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_disk_over_web_server/test.py::test_cache[node2]' test_disk_over_web_server/test.py::test_config_reload test_disk_over_web_server/test.py::test_incorrect_usage test_disk_over_web_server/test.py::test_page_cache test_disk_over_web_server/test.py::test_replicated_database test_disk_over_web_server/test.py::test_unavailable_server 'test_disk_over_web_server/test.py::test_usage[node2]' test_disks_app_func/test.py::test_disks_app_func_cp test_disks_app_func/test.py::test_disks_app_func_ld test_disks_app_func/test.py::test_disks_app_func_ln test_disks_app_func/test.py::test_disks_app_func_ls test_disks_app_func/test.py::test_disks_app_func_mv -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa ' returned non-zero exit status 1.